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Abstract. The aging regime of the trap model, observed for a temperature 
T below the glass transition temperature T g , is a prototypical example of non- 
stationary out-of-cquilibrium state. We characterize this state by evaluating its 
"distance to equilibrium", defined as the Shannon entropy difference AS (in 
absolute value) between the non-equilibrium state and the equilibrium state with 
the same energy. We consider the time evolution of AS and show that, rather 
unexpectedly, AS(t) continuously increases in the aging regime, if the number 
of traps is infinite, meaning that the "distance to equilibrium" increases instead 
of decreasing in the relaxation process. For a finite number N of traps, AS(t) 
exhibits a maximum value before eventually converging to zero when equilibrium 
is reached. The time t* at which the maximum is reached however scales in a non- 
standard way as t* ~ N T &/ 2T , while the equilibration time scales as r cq ~ N T s/ T . 
In addition, the curves AS(t) for different N are found to rescale as In t/ hit*, 
instead of the more familiar scaling t/t* . 



PACS numbers: 02.50.-r,05.40.-a,64.70.P- 

1. Introduction 

The aging phenomenon has attracted a lot of attention in the last decades, both at 
the experimental and theoretical level pQ. Though being a genuine non-equilibrium 
state, the aging regime is often intuitively considered as a progressive relaxation to 
the equilibrium state, where the state of the system slowly gets closer and closer 
to equilibrium [2 . In spite of the fact that most realistic models can only be 
studied through extensive numerical simulations [3], some very simplified mean- 
field models, like the trap model [4J [5] and the Barrat-Mezard model [6l [7], have 
been proposed in order to gain understanding on the time-dependent probability 
distribution of microscopic configurations. In such models, this time-dependent 
probability distribution can be worked out exactly, thus providing a benchmark for 
testing possible generic ideas or scenarios on the aging regime. The first result 
that comes out of these simple models is that, in the aging regime, microscopic 
configurations with small enough trapping times are essentially equilibrated, while 
configurations with very large trapping times are still strongly out of equilibrium. 
The crossover trapping time between equilibrated and non-equilibrated configurations 
is precisely of the order of the age of the system, that is the time elapsed since it 
entered the low temperature phase. As the system ages, the fraction of equilibrated 
configurations increases, thus apparently confirming the scenario that the system 
progressively gets closer and closer to equilibrium. 
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Although this scenario appears intuitively appealing, it would be interesting to 
provide a quantitative characterization of this convergence to equilibrium, for instance 
by computing a "distance to equilibrium" as a function of time. A natural candidate 
to quantify the distance to equilibrium is the Shannon entropy difference [HI |H| between 
the non-equilibrium state and the equilibrium state with the same average energy: 

AS = S cq ((E) ncq ) - S ncq > (1) 

where (E) ncq is the average energy in the non-equilibrium state, and S ncq is the 
Shannon entropy of this state. Indeed, the equilibrium state maximizes the entropy 
for a given average energy, and this distance then vanishes by definition. Note that 
this Shannon entropy difference identifies with the Kullback-Leibler divergence |10j , or 
relative entropy, between the corresponding non-equilibrium and equilibrium states. 
It is also interesting to note that AS characterizes the dependence of the fluctuation- 
dissipation ratio on the observable considered [9]. 

If an equilibrium state exists, AS* should converge to zero in the long time limit. 
It is however not obvious that the relaxation to zero should be monotonous. To 
make a more specific statement, we first note that for any stochastic markovian model 
having the canonical distribution at temperature T as equilibrium distribution, the 
time-dependent free energy F(t) = (E) ncq (t) — TS ncq (t) is a decreasing function of 
time [11]. On the other hand, the time-derivative of AS* can be evaluated as 

it AS = rpy di {E)ncq ~ i Sncq (2) 

where we have introduced the microcanonical temperature T{E) 1 defined as 
1 _9S cq 



T U-(£>ncq--^ noq ). (4) 



T(E) dE ' 

Eq. ([2]) can then be compared with the time derivative of the free energy 

dt \Tdt { )ncq dt 
Hence, if T({E) ncq ) is close to the heat bath temperature T, 
d A „ dF 

dt AS ~lt^ (5) 
and AS* decreases. In the opposite situation, if T((E) ncq ) is significantly different from 
the bath temperature T, the evolution of AS with time may not be monotonous. 

In addition, if an equilibrium state does not exist, as is the case for instance 
in the trap model with an infinite number of traps (in which case the equilibrium 
distribution is no longer normalizable) , no precise statement can a priori be made on 
the evolution of AS. However, the intuitive argument on the progressive equilibration 
of the different degrees of freedom suggests that AS should decrease with time. 

In this short note, we compute the entropy difference as a function of time in the 
trap model, and show that the behavior of this quantity is quite different from naive 
expectations. Instead of monotonously decreasing to zero with time, this quantity 
first increases during the aging regime, before saturating and decaying to zero. This 
non-monotonous behavior can be understood as the succession of two regimes: a first 
aging regime which can be described within a continuous formalism (meaning that 
the system essentially behaves as if the number of traps was infinite), and a second 
regime where the finiteness of the number of traps plays an important role. 
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2. Trap model 

The trap model is defined as follows [4j [5] . A particle is trapped in one among a large 
number N of traps, whose bottom energy is drawn from an energy distribution p(E), 
with E < 0. The standard choice for p(E) is the exponential distribution 

p(E) = ±e-W/ T * (E<0), (6) 
1 s 

which defines the energy scale T g . The particle follows a continuous time markovian 
stochastic dynamics, with an escape rate T e E ^ T from a trap of depth \E\, where T is 
the heat bath temperature; Tq is a microscopic frequency, set to unity in the following. 
After the particle escapes a trap, it chooses at random a new trap among the N traps. 
The transition rate Wj% from trap i to trap j reads 

^ = ^ i/T (7) 

This transition rate satisfies detailed balance with respect to the equilibrium Gibbs 
measure, namely 



•jji c- - — - 



(8) 

which ensures that the probability distribution eventually reaches equilibrium. 

In the limit of an infinite number of traps, all configurations with energy E can 
be gathered in a single, coarse-grained, configuration (see [5] for details), yielding for 
the transition rates 

W{E'\E) = p{E')e E/T . (9) 

The master equation for the probability P(E,t) that a particle occupies a trap of 
energy E at time t is 

dp r° 

— (E,t)= [W{E\E')P{E',t)-W{E'\E)P{E,t)]dE', (10) 

J -co 

Detailed balance is also satisfied within this continuous description, and the 
equilibrium measure reads 

P cq (E) = ±p(E)e- E / T . (11) 
Quite importantly, it turns out that the normalization constant Z , defined as 

Z= f p(E) e~ E l T dE 

J —OO 



— OO 



' dE, (12) 



exp 



oo 



T„ T 



diverges for T < T g . This means that P cq (E) becomes non-normalizable for T < T g , so 
that no equilibrium distribution can be defined in the limit of an infinite number N of 
traps where the continuous energy formalism is valid. For a finite N, the equilibrium 
distribution however exists, and concentrates on the few lowest energy levels. For 
T < T g , the system enters an aging regime in which the probability distribution takes 
the form, for large enough time t, 

P(£,t)wi*(!+lntJ, (13) 
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where the dimensionless function $ can be computed exactly [5] . In the marginal case 
T = T g , the probability P(E,t) has a slightly different form Q2]. From Eq. ([15]). it is 
obvious that at large time the average energy is given by (£ , ) a g ~ —Tint. Computing 
the tails of $, one finds that small traps with energies much smaller than (-E) ag in 
absolute value are essentially equilibrated, that is, P(E,t) ~ p(E) exp(— E/T), while 
large traps with \E\ 3> Tint remain equiprobable, namely, P(E,t) ~ p(E). For a 
large but finite number of traps, this aging regime is interrupted when (E) as becomes 
of the order of the lowest energy levels. 



3. Entropy difference with the closest equilibrium state 

3.1. Entropy in the aging regime 

Considering a finite number N of traps, the time-dependent entropy S(t) can be 
introduced using the standard definition 

N 

S(t) = -J2 p i(t)^ p i(t)- (14) 
i=i 

where P, (t) is the probability that the particle is in trap i at time t. In the continuous 
energy approximation, the number of traps having an energy between E and E + dE 
is Np(E)dE, so that Pi(t) can be estimated as 

W) « §H (15) 
The entropy can then be written as 

w--L« E - , H%m) dE - (16) 

In the aging regime, one finds, using the "travelling" form Eq. (IT3l) for P(E, t) 

5 ag (i) = ^(T) ag + 5o+ln^+ln7V, (17) 
where the constant So is given by 

/oo 
$(u)ln$(u)du. (18) 
-co 

For the temperature T = T g /2 used below in the numerical simulations, one has 
So w 2.41. 



3.2. AS in the infinite size limit 

We now wish to compute the entropy difference AS between the aging state and the 
equilibrium state of the system with the same average energy. To this aim, we need 
to determine both the equilibrium entropy and the equilibrium average energy as a 
function of temperature, and then to express the entropy as a function of the energy. 

Let us first compute the equilibrium entropy at an arbitrary temperature T a . 
Taking P oq (£',T a ) = Z~ x p(E) e- E < T % we find for T a > T g , using the definition of the 
entropy given in Eq. (|T5|) . 

S cq (T a ) = ^(E) cq + ln(—^— ) +\nN. (19) 
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In addition, the equilibrium average energy can be easily computed, yielding 

(£> eq (T a ) = --p% (T a >T g ). (20) 

Ja -Lg 

Inverting this relation to express the temperature as a function of the energy yields 

1 l^" 1 



T g E 



T,{E) = - + - . (21) 



Hence the equilibrium entropy reads, as a function of the energy 

E , f\E" 
h In — 



S eq (E) = — + In ( Li ) + 1 + In JV. (22) 



From Eq. (|17[) . we can also express the entropy in the aging regime as a function of 
the energy E = (E) ag , 

S a , g (E) = ^-+S +\n^-+lnN. (23) 

The entropy difference AS* = S cq — S ag is thus obtained as 

AS(E) = In (&j - So - In ^ + 1. (24) 

Using (-E)ag ~ —Tint in the aging regime, one eventually finds 

AS(t) wlnlni-5o + l. (25) 

Hence AS 1 increases as a function of time, which means that the distribution P(i7, t) 
becomes more and more dissimilar to its equilibrium counterpart. Thus, relaxation 
in the aging regime of the trap model proceeds through states that get further and 
further away from equilibrium. 



3. 3. AS for a finite number of traps 

As long as the number of traps is infinite, no equilibrium state can be reached, and 
AS(t) grows without bound. However, in the presence of a finite number of traps, the 
system eventually reaches equilibrium, so that AS(t) should decrease to zero beyond 
a characteristic time scale. 

Fig. HJa) presents the numerical results obtained by simulating the stochastic 
dynamics of the model with a finite number N of trap. The resulting entropy difference 
AS(t) is averaged over a large number of realizations of the disorder, that is, of the 
quenched energies of the traps. One observes that AS(t) has a maximum value for a 
finite time t* , and then decreases to zero, albeit at a very slow rate. 

A more surprising observation is the scaling with N of t* , for which we find, 
for T = T g /2, t* ~ N within numerical accuracy; see Fig. [T](b). Indeed, a simple 
argument would to be say that the crossover should be observed for a time t* of the 
order of the equilibration time r cq , when the average energy (E) ag (t) becomes of the 
order of the minimal energy E m i n of the N traps. Since trap energies are independent 
and identically distributed random variables drawn from the exponential distribution 
p{E), one finds E m \ n w — T g lniV, yielding t* ~ r cq ~ N T& / T . For the temperature 
T = Tg/2 considered in the simulations, one has r eq ~ N 2 , while the numerically 
observed scaling is t* ~ N <g; r cq . Hence the equilibration time alone cannot account 
for the observed crossover. 




t N N 



Figure 1. (a) Entropy difference AS as a function of time, for different numbers 
of traps N = 10 2 , 3 X 10 2 , 10 3 , 3 X 10 3 , 10 4 , 3 X 10 4 and 10 5 (from bottom to 
top) . Data were obtained by averaging over 500 realizations of the disorder (trap 
depths) the entropy difference computed for each sample (T = 0.5T g ). (b) Time 
t* at which AS is maximum, as a function of the number N of traps. The dashed 
line indicates a slope T g /2T = 1. (c) AS* = AS(t*) as a function of N. The 
dashed line is the prediction for AS* given in Eq. 1 138 II . 



As we shall see below, the reason for this discrepancy actually comes from finite 
size effects in the calculation of the equilibrium entropy. To take into account these 
finite size effects, one can as a first approximation include a cut-off at E m i n w — T g In N 
in the distribution p(E). Hence, for instance, the average equilibrium energy at 
temperature T a = f)~ is computed as 

(E} cq = ^[° Ee^~^ E dE (26) 

A J-T s \nN 

with j3 g = T~ l and 

r° 

Z = /3 S eV'-M 11 dE, (27) 

J—T. In N 



yielding 



, , T„ ( alniV , 



Interestingly, this expression of the energy takes a scaling form with the number N of 
traps, namely 

(£> eq = T g lniV/(alniV), (29) 
where the function f{x) is given by 

e x — 1 x 

It can be shown easily that f(x) ~ —1/x for x — > +00 and f(x) — > —1/2 when x — >• 0, 
so that we set /(0) = —1/2. One can also show that f(x) is an increasing function, 
so that the reciprocal function g(y) = / _1 (y) can be defined. One then has 
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-AS = /3 a (E)-/3 s = -l3 s a(E), (34) 



From the behavior of f(x), it follows that g(y) ~ — 1/y when y — >■ and g(—l/2) = 0. 
Note that the monotonicity of g(y) implies that it has a single zero. 

Using Eq. (TTBf and taking into account a finite-size cut-off — T g lnA, the 
equilibrium entropy for a finite number A of traps is found to be, once expressed 
as a function of the average energy E, 

S eq {E) = \nZ(/3 a (E)) + /3 a {E)E + hxN, (32) 

where f3 a (E) is obtained from Eq. (|3"Tj). taking into account Eq. ([28)) . Assuming, 
consistently with the numerical observations, that t* -C T oq , the non-equilibrium 
probability distribution P(E,t) should still take its aging form Eq. (p~3|) for t ~ t* . 
Hence the non-stationary entropy can still be evaluated through Eq. (jTTJ) in this 
regime, yielding for the entropy difference AS 

AS(E)=S m (E)-S as (E) 

= lnZ(p a (E)) + (p a (E) - p s )E -ln^ - S . (33) 

Considering E = (E) ag as a function of time, we look for the time t* at which AS 
is maximum. This maximum is obtained for d(AS)/dt = [d(AS)/dE] (dE/dt) = 0, 
and hence for an energy E(t*) such that d(AS)/dE — 0. The derivative of AS with 
respect to E reads 

_d_ 

dE~ 

where we have used the relation dlnZ/d/3 a = —E. The maximum of AS is thus 
obtained for t = t* such that ct(E(t*)) — 0. From Eq. (|3"Tj) . this corresponds to 
E(t*) = -\T g h\N. Using E(t) Tint, we eventually obtain 

t* ~ N T ^ 2T . (35) 
This estimation is indeed consistent with the numerical observations, as seen on 

Fig-ntb). 

Let us now evaluate AS** = AS(t*). From Eq. (|27|) . one can rewrite Z as 
Z = In N h(a In N), where the function h(x) is defined by 

h(x) = -(1 - e- x ), x^O, (36) 
x 

and h(Q) = 1. Then, using Eq. (|33|) and ([29| . AS can be rewritten as 

AS = In In N - Si + In h(a In N) — a In AT/ (a In AT) , (37) 

where we have introduced the notation Si = So + hx(T/T g ). For t = t*, one has 
a = a(E*) = 0, so that 

AS* =\nhiN - Si. (38) 

This result qualitatively agrees with the numerical simulations, though a significant 
shift is observed, as seen on Fig.[ljc). This shift is likely to be due to the approximation 
made by taking into account the finite N effects through a simple cut-off in the energy 
distribution. 

In addition, coming back to Eq. (|37p . we can express a In A as a function of 
the rescaled energy E/(T g \nN) through Eq. (|3T|) . and then use the time-dependence 
E = (E) ag « — Tint for the energy, yielding 

TdnA ~ ~2 hO* ^ 39 ' > 



0.5 1 1.5 2 

In t / In t 



Figure 2. Shifted entropy difference AS — In In AT + Si as a function of the 
rescaled logarithmic time lnt/lnt*, for different numbers of traps. Data are the 
same as in Fig. [Ha); from top to bottom: N = 10 2 , 3 X 10 2 , 10 3 , 3 X 10 3 , 10 4 , 
3 X 10 4 and 10 s . The dashed line corresponds to the analytical form given in 
Eq. l|40t . 



where we have also used the expression of t*. Combining Eqs. (|57)l . (JSU) and 
one finally finds that AS — In In N + Si is a function of the logarithmically rescaled 
time \nt/\nt*: 



We test this property on Fig. [21 and find that, though strong finite size effects arc 
present, this rescaling of the numerical data seems to be asymptotically satisfied. The 
expression given in Eq. (|40| is also plotted on Fig. [2] for comparison. Here again, a 
significant shift on AS is present with respect to the numerical data, for the same 
reasons as on Fig.pTc). However, apart from this shift, the overall shape is reasonably 
well reproduced, except in the tails. These discrepancies for both short and large 
times are due to the fact that the travelling form Eq. (fT5)l of the aging distribution 
P(E, t) is no longer valid in these regimes. 

4. Discussion and conclusion 

In this short note, we have computed in the trap model the entropy difference AS 
between the aging state and the equilibrium state with the same energy. For an infinite 
number of traps, a simple calculation shows that AS actually increases without bound 
as time elapses, contrary to the naive expectation based on a scenario of progressive 
equilibration. For a finite number of traps, when an equilibrium state exists for a heat 
bath temperature T < T g , AS first increases before eventually decreasing to zero in 
the long time limit. The characteristic time t* at which the maximum of AS* occurs is 
however much smaller than the equilibration time T cq , and one actually finds a strong 
scale separation between these two times, according to t* ~ (Tcq) 1 / 2 . 

Beyond these results, let us mention that the entropy difference AS appears as 
an interesting quantity to statistically characterize the aging regime. Indeed, the 
standard Kovacs memory effect [T3], reproduced in numerous numerical or analytical 
models [2J H3 HS1 [IZ1 HS1 EH] ; confirms that standard macroscopic observables like 
the energy or the density are not enough to characterize the macroscopic state of 



AS - In In AT + Si =lnh(x) - xf{x), 




(40) 
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a system in the glassy phase. The Kovacs protocol consists in suddenly raising the 
temperature from a value T\ (at which the system is glassy) to a value T 2 > T\, 
precisely at the time t r when a given macroscopic observable (typically density or 
energy) reaches its equilibrium value at T2 U If such an observable was enough to 
describe the macroscopic state of the system, this observable would no longer evolve 
with time for t > t r , having already reached its equilibrium value at temperature T2. 
In contrast, observations show a non-monotonic evolution of the observable, which 
starts to depart from its equilibrium value before eventually returning to it. At a 
macroscopic level, this behavior can only be understood if at least another variable, 
that has not yet reached its equilibrium value, is present. As such a variable should in 
some sense quantify the deviation from equilibrium, the entropy difference A5 turns 
out to be a natural candidate. In addition, as the energy is close to the equilibrium 
energy at T 2 , the relaxation of AS should be essentially monotonous, according to the 
arguments presented in the introduction. 
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X A correction related to the rapid energy increase of fast degrees of freedom however has to be taken 
into account in realistic models. In the trap model, these fast degrees of freedom, like bottom-of-the- 
well vibrations, are not present. 



